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^ We study a further refinement of the standard refined enumeration of alternating 

sign matrices (ASMs) according to their first two rows instead of just the first row, 
and more general "cZ-refined" enumerations of ASMs according to the first d rows. 

i '~ l i For the doubly-refined case of d = 2, we derive a system of linear equations satisfied 

by the doubly-refined enumeration numbers A n> i j that enumerate such matrices. We 
give a conjectural explicit formula for A n ^j and formulate several other conjectures 

C-T) about the sufficiency of the linear equations to determine the ^4 n! jj's and about an 

extension of the linear equations to the general ci-refined enumerations. 

in 

1 Introduction 

1.1 Alternating sign matrices 

> 

An alternating sign matrix (ASM) of order n is an n x n matrix with entries 
in {0,-1,1} such that in every row and every column, the sum of the entries is 
1 and the non-zero numbers appear with alternating signs; see Fig. 1(a) for an 
example with n = 5. Alternating sign matrices were first defined and studied in 
the early 1980's by David Robbins and Howard Rumsey in connection with Charles 
Dodgson's condensation method for computing determinants. They discovered, and 
later proved |llj . that the A-determinant, a natural generalization of the determinant 
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that arises from the condensation method, has an expansion as a sum over all 
ASMs of order re, just as the ordinary determinant has an expansion as a sum over 
permutation matrices. 

Robbins and Rumsey were also interested in the enumeration of ASMs. To- 
gether with William Mills, they denoted by A n the total number of ASMs of order 
re, and by A n ^ for 1 < k < re the number of ASMs with a 1 in position k of row 1, 
and conjectured [9] two important enumeration identities, nowadays known as the 
alternating sign matrix theorem and the refined alternating sign matrix 
theorem, which state that 

a - = u¥t^ and w 

(n + k-2\ (2n-fc-l)! ^ T 2 (3j + l)! 
n ' k ~ \ k-1 J (n-k)\ f} (n + j)\- [) 

The attempt to prove these celebrated conjectures and subsequent developments 
have led to a rich combinatorial and algebraic theory relating ASMs to other com- 
binatorial objects such as domino tilings and plane partitions, to representation 
theory and to the six-vertex model and other related lattice models in statistical 
physics. Eqs. Q and pi) were proved by Zeilberger [HI EI], who in the refined case 
of ([2]) (which contains (|lj as a special case, since A n ^ = A n -i, and took longer to 
prove) used the square-ice techniques introduced by Kuperberg [B] in his simplified 
proof of ([T]) . An alternative proof of ([2]) using entirely different methods was found 
by Fischer [5j [6]. Other variations on the Kuperberg- Zeilberger approach lead to 
different derivations of ([I]) by Colomo and Pronko |2] and of ^ by Stroganov [12] . 

Our goal in this paper is to extend these enumeration results to more refined 
enumerations of ASMs. In the simplest case, which we call the doubly-refined 
enumeration, we will define numbers A n ^j that enumerate ASMs based on their 
first two rows rather than the first row^] We will present a conjectural explicit 
formula for A n i that turns out to be considerably more complicated than the 
product formulas ([I]) and ([2]). While proving this formula may look challenging, 
we take a significant first step by deriving and proving a system of linear equations 
satisfied (for each fixed re) by the numbers (A nt ij)ij. Assuming a natural conjecture 
that we will formulate concerning the sufficiency of these equations to determine the 
An,i,j% proving the explicit formula is reduced to the (possibly quite complicated, 
but essentially mechanical) verification that the expression given by that formula 
satisfies the system of linear equations. 



1 Thcre is a different doubly-refined enumeration based on the first and last rows, studied e.g. in 
[21 III [12], which we will not discuss in this paper. 
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One can also consider the triply- refined, quadruply-refined, and more generally 
the d-refined enumeration of ASMs based on their first d rows. Our main result 
concerning the system of linear equations extends conjecturally (and empirically for 
d = 3 and small values of n) to this generality. We believe our techniques are also 
relevant for attacking this more general problem (they are in fact an extension of the 
techniques used in |6 j to attack the original refined case of d = 1). The existence of 
such detailed equations governing the (f-refined enumeration is surprising and may 
offer a useful tool for attacking important open problems such as the problem of the 
limit shape of large random ASMs, for which a conjectural formula is given in jj]. 

1.2 Monotone triangles 

To formulate our results precisely, we need first to define the doubly-refined enu- 
meration numbers A n ^j. This is more conveniently done in terms of a family of 
objects called monotone triangles that are related to ASMs. A monotone triangle 
of order n is a triangular array (ti,j)i<i<n,i<j<i of integers satisfying the inequalities 

t i; j < Uj + i, Uj < U-xj < Uj+x (2 < i < n, 1 < j < i — 1). 

In other words, in the coordinate system traditionally used to draw them, monotone 
triangles have strictly increasing rows and weakly increasing northwest-southeast 
and southwest-northeast diagonals; see Fig. 1(b). 

It is well-known (see [1] [10]) that ASMs correspond under a simple bijection to 
complete monotone triangles, which are monotone triangles with the numbers 
1,2, ...,n in the bottom row. Formally, the bijection maps the ASM M = (rriij) 
to the monotone triangle T = (ttj) such that t^x < tip < ii,3 < • • • < are the 
positions of the l's in row i of the column-sum matrix S = (sjj )" J=1 of M defined 



Using this bijection and the obvious symmetry with respect to vertical reflection 
in the definition of ASMs, it is easy to see that the enumeration and refined enu- 
meration numbers A n and A n ^ have the following equivalent definitions in terms of 
monotone triangles: 

A n = the number of complete monotone triangles of order n, 
A n k = the number of complete monotone triangles of order n with the 
number k in the first row 
= the number of monotone triangles of order n — 1 with the 



by 




r=l 



numbers 1, 2, . . . , k — 1, k + 1, . . . , n in the last row. 
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2 5 
1 4 5 
12 4 5 
1 2 3 4 5 
(b) 



2 5 
14 5 
12 4 5 
1 2 3 4 5 
(c) 



Figure 1: An ASM of order 5, the corresponding complete monotone triangle, and the 
(2, n)-trapezoid obtained by deleting its first row. 



1.3 The doubly-refined enumeration 

Our definition of A n jj is a natural generalization of For n > 3 and 1 < i < j < n, 
let 

A n ,i,j = the number of order n — 2 monotone triangles with the 
numbers 1, 2, . . . , i, . . . , j, . . . n in the last row, 

where the notation i,j means that i and j are omitted from the list. Equivalently, 
we can look at the second row of a monotone triangle and write 

A n ,i,j = the number of monotone (2, n)-trapezoids with 

1,2, ... ,n in the last row and i, j in the first row, 

where a monotone (2, n)-trapezoid is a monotone triangle without its first row (see 
Fig. [TJ , or again equivalently 

A n i j = x ( the number of complete monotone triangles with 

j-i+i y 

the numbers i,j in the second row^ , 

since given the values i,j in the second row, the number in the first row can be any 
integer in and has no influence on the numbers below the second row. 

It is also possible to interpret the numbers A n ^ j directly in terms of the enumer- 
ation of classes of ASMs. Translating the above definitions to the language of ASMs, 
it is not difficult to see that for each triple k) such that l<i<k<j<n and 
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Figure 2: The possible configurations for the first two rows of an ASM: (a) i < k < j. (b) 
i = k < j. (c) i < k = j. In all three cases the number of ASMs with the given first two 
rows is A r 



i < j, we have that 

An,i,j = the number of ASMs (m P)9 )p _ =1 of order n satisfying 

mijjfe = 1, m2 j9 = for q / i, j, k and 

r (1,-1,1) i<k<j, 
(m2,i,m 2j fe,m 2l j) = < (0,0,1) i = k<j, 
( (1,0,0) i<k = j, 

since the ASMs on the right-hand side correspond to monotone triangles with the 
number k in the first row and the numbers i,j in the second row. Thus the numbers 
An,i,j exactly enumerate ASMs based on their possible leading two rows; see Fig.[2j 
Note that we have the special values 

An,i,n = (l<i<n), (4) 

and that the A n ^js satisfy the symmetry property 

An^j = A n ^ n+ i-j^ n+ i-i (1 < i < j < n), (5) 

which follows from the symmetry in the definition of ASMs with respect to horizontal 
reflection. 

In what follows, we denote 

n\ C n(n-l)(n-2)...(n-k+l) ^, > q 



kj i otherwise, 

n\ r ffl n>0, 



k j , 1 otherwise. 



We can now formulate our results. 
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Figure 3: The numbers (A 5i jj)f J=1 . 



Theorem 1 (Linear equations). Define 

c,,, M ={(- 1 » i+ ' +1 (^ 1 ) + -("-) + ) (6) 
[0 otherwise. 

For each n > 1, extend the triangular array of numbers (A n j j)i<i<j<n to a square 
matrix of numbers (A nt ij)fj =1 by setting 

A . . — J * < (7\ 



El<p< ? <n C i,j,P,qA n ,p,q i> j 

Then the extended numbers (A nt ij)f •_ 1 satisfy the system of linear equations 

= E E(-i) p+9 ( 2n ~_ z 7 2 ) ( 2n ~_ j 7 2 ) 4mm. (i<m<«). (8) 



Figure [i] shows a table of the numbers (Aj.ijOi,:? f° r n = 5. See Appendix A for 
a tabulation of these numbers for 3 < n < 7. Note the following interesting special 
of@: 



cases 

71-1 



K,n,i = -J2 An ~^ r 0-<J<n), (9) 



r=j 

n-1 
i=l 

-^n.n.n = 0. 
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We also prove the following result, which extends the symmetry property ([5| in 
a surprising way. 

Theorem 2 (Near-symmetry). The extended numbers (A n ^j)fj =1 satisfy the sym- 
metry property 

An,i,j = ^4n,ri+l— j,n+l— i (10) 

for all 1 < i,j < n, except when = (n— 1, 1) or = (n,2), in which cases 
we have 

Ai,Ti-l,l = An-2, A nn o = A n _2 — Ai-1- (H) 



The near-symmetry equations (10) for j < i, ^ {(n — 1,1), (n, 2)}, are an 

additional set of linear relations satisfied by the Anjj's, hence (by substituting the 
definition of An,ij from ([7]) in both sides of (|10[)) by the original A^^j's. Some 
of these relations are quite simple - for example, setting i = j = 1 we get that 
An,i,l = A n .n,n = 0, which translates to 

n— 1 

^(-l) i+ M n , iii+1 = 0, 
1=1 

an identity which follows trivially from the symmetry of the An ij's when n is odd, 
but has interesting content when n is even, and raises the question whether this 
equation has a direct combinatorial explanation. 

A natural question is whether the set of linear relations we found for the A n ^'s, 
together with the "boundary" information Q, is sufficient to determine them. 
Strong numerical evidence suggests that the answer is positive. 

Conjecture 3 (Sufficiency). The equations together with the near-symmetry 
equations (10), (11) and the special values Q, determine the numbers A n ^j uniquely. 

It is also natural to ask whether a closed-form expression analogous to the prod- 
uct formulas and ^ exists for the A ni jj's. Assuming Conjecture [3] because 
of Cramer's rule it should be possible to write a formula that expresses A n ^j as 
a quotient of determinants. We also found the following formula, which is more 
explicit than a determinantal formula but still considerably more complicated than 
the formulas @> @- 
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Conjecture 4 (Explicit formula). For ^ {in — 1, 1), (re, 1), (n, 2)} we have: 



Bn,i,j{jl ~\~ j i 1 ~\~ Pn,i,jSn,i,j) > 



where we make the following definitions: 



B 



P, 



s„ 



H„ 



(3n-5)!(n-2)! 



(2n - 2 - i)!(2n - 2 - j')!(n + 1 - 3)!(n + j - 3)! 

(t-l)!0'-l)!(n-»)!(n-i)! ; 



2 + 2i + i 2 - 3j - ij + j 2 - 2n - 2m + jn + n 2 , 

max(i— 2) 

fc=min(0,j— i) 



r (~l) J+fc+1 /3fc-3j+4\ /2j+»-2fc-5\ / i-2 W - _ s 
k-j+3-n\ k J\ i-k-1 /Kk-j+i)" L > 

x (3i^3j~2fc-5 — 3ff3j_3fc_5 + 2i^2j"+i— 2fc— 5 



-2Ho-i-h-i + #fc- 



2j-fc-4 "I" ^fc-j+i - Pj-k-2 + fc-j+3-n 



/3fc-3j+4\ /'2i+i-2fe-5\ 
V fc A i-fc-1 J 

I ( fc Ti+*)(fc-i+3-n) 

r (- 1 )' +fc+1 /'3fe-3i+4N /3j-2fc-5\ (t-1 \ / ■ _ , _ n 
fc-j+3-n I fc-H-j M j-fc-l S \ k )\J ft X J 

x (Hsj-2k-5 — H2j-k-A — Hk + Hi-k-l) 



(1)(k-j+3-n)i 

£3Li a m ^ J > 



j — i<k<j — 2, 
otherwise, 

< fe < i — 1, 
otherwise, 







otherwise. 



For € {(n — 1, 1), (n, 1), (n,2)} (where the values of A n ^j are known anyway) 
the formula above can be made to work by cancelling the zero of P n ,i,j with the 
appropriate singularity of S n> ij. 

We verified Conjectures [3] and [4] numerically up to n = 30. See Appendix B for 
details on how to compute the A n j^-'s and verify the formulas using Ref inedASM, 
the companion Mathematica software package to this paper. Note that S n ij defined 
above also has the following more succinct (but less explicit) representation: 



Si 



lim 

j'-*3 



i-1 



^3fc-3/-|-4\ /2i'+i-2fe-5N ^3fc-3i+4^ /2i+j'-2k-5\ ^ _ 1 _ j^y 



o V ( i-t l W - f + 3 - n) { k ~^ )( k -i + 3-n)i 
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1.4 The d- refined enumeration 



The linear equations in Theorem[T]extend conjecturally to the <i-refined enumeration 
of ASMs, for any d > 1. Once again, the formulation in terms of monotone triangles 
turns out to be the most convenient. 

Conjecture 5 (Linear equations for the (i-refined case). For 1 < d < n and 

1 < i\ < ii < . . . < id < n, let ■A n ,i 1 ,i 2 ,...,i d denote the number of monotone tri- 
angles of order n — d whose bottom row consists of the numbers in {1,2, ... ,n} \ 
{ii, 12, ■ ■ ■ , id} arranged in increasing order (if d = n then we set A n i2 t ... n = ^-)- 
Then (Ai,ii>-,id)ii<-<*d can be extended into an array (^4n,ii,...,i d )l<ii,...,i d <n such 
that the equations 

n n n 

A n , iu ..., id = ( ii-' E E ■ • • E (-iy i+ - +jd 

ji=h n=h jd=id 

n( In — i r — d\ j 
• _• ) A n,j d ,...,j2,ji I 1 < *i,«2,...,*rf < n) (12) 

r=1 \ Jr Ir J 

hold. 



1.5 A family of polynomial expansions 

We now formulate another result on the doubly-refined enumeration numbers (with 
a corresponding conjectural extension to the d-refined enumeration for d > 3) that 
is more conceptual than the linear equations Q described above, and whose proof 
will take up the main part of the paper. At the same time we also outline how this 
result will be used to derive the main results formulated above. 
To introduce this result, we consider the function 

ot n (ki,k 2 ,. . . ,k n ), 

defined in [5], that counts the number of monotone triangles with bottom row 
{k\, . . . ,k n ). This function is a polynomial with many useful symmetries. In {6| 
it was proved that the one-variable polynomial defined as a specialization of a n by 

G n (x) = q„(1, 2, 3, . . . , n - 1, n + x) 

has the symmetry G n (x) = (— l) n ~ 1 G n (— 2n — x) and that on the other hand, G n (x) 
is related to the refined enumeration numbers A n ^ via the polynomial identity 

Gn{x) = j^A n J X+ k k _- 1 ). (13) 
k=i ^ ' 
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In other words, the ^4 ni fc's appear as the coefficients in the expansion of G n {x) in 
the linear basis ( i^X^ 1 ) J to the space of polynomials in x. By combining this 



fe>0 

with the symmetry property one gets a system of linear equations satisfied for each 
n by the A n ^'s, which was used in [6] to give a new proof of the refined alternating 
sign matrix theorem. 

We now extend this idea by considering the two-variable polynomial 

G n (x,y) = a n (l,2,3, . . . ,n- 2, n- 1 + x,n + y). (14) 

As before, it will follow from the results of [6] that G n (x,y) satisfies a simple sym- 
metry property. It turns out that G n (x,y) can, analogously to (13), be related to 
the (extended) doubly-refined enumeration numbers. We will prove the following 
identity. 



Theorem 6. 



M = l 

Again, this can be thought of as an expansion of the polynomial G n (x, y) in the 
linear basis {(^l^ 1 ) (j-\)}i,j>0 to the space of polynomials in x and y. The linear 
equations Q will follow relatively easily from a combination of this expansion with 
the symmetry property of G n (x,y). Along the way we gain enough information 
about the A^ij's to also deduce Theorem ^1 

Theorem [6] and eq. (13) also extend conjecturally to the d-refined enumerations 
for d > 3, in the following form. 

Conjecture 7. For each d>l, define the polynomials G n (xi, . . . ,Xd) (n > d) by 

G n (xi, . . . , Xd) = a n (l, 2, . . . , n—d, n— d+l+xi, n— d+2+x 2 , n—l+Xd-i,n+Xd). 

Let (Fn,j 1 ,j2,—,jd)j' 1 j d =i ^ e the coefficients of G n (x\, . . . ,Xd) when expanded in the 
basis 

r x x + ji - 1\ (xi + j 2 \ fx d + jd + d - 2\ 1 

ii-i y v J2 - 1 y " ' V id-i //,,,,, ,, -i 

to the space of polynomials in x±, . . . ,x d , so that the equation 

G n {xi, ...,x d )= F n ,h,...,j d n ( Xr + j T *i 2 ) 

holds. Then we have, in the notation of Conjecture^ 

'■'"■r. = A n,h,...,j d (1 < il < 32 < ■ ■ ■ < 3d < n). 
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The coefficients (F n j 1 j d )j 1 j d will give the "extended" enumeration numbers 
■,3d)h,—,3d wnose existence is the subject of Conjecture [HI In Section IHlwe will 
prove the following result, using the same ideas that were outlined above for how 
Theorem [T] can be deduced from Theorem [6l 

Proposition 8. Conjecture^ implies Conjecture^ 

1.6 Acknowledgements 
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2 Preliminaries 

2.1 The polynomial a n (k\, . . . , k n ) 

For integers k\ < k 2 < . . . < k n , let a n (ki, . . . , k n ) as before denote the number of 
monotone triangles with bottom row (fei, . . . , k n ). From the definition of monotone 
triangles, the function a n (k\, . . . , k n ) satisfies the recurrence relation 

a n (ki,...,k n )= ^2 oi n -i(ji,...,j n -i). (15) 

ji < ... < jn-l 
h < jx < k 2 < . . . < j n -i < k n 

It will be useful to note that if the fcj's are only weakly increasing, i.e., ki < k 2 < 
. . . < k n , then we can extend the definition of a n (ki, . . . , k n ) to such a vector using 



the recurrence (15). This has the interpretation that this extended function counts 
the number of almost-monotone triangles with a prescribed bottom row, where 
an almost-monotone triangle satisfies the same inequalities as a monotone triangle 
except that its bottom row is only required to be weakly increasing. 

In [5l Th. 1] it was shown that one can extend the definition of a n (ki . . . , k n ) 
even further to any vector of numbers, since it is a polynomial function in the 
variables k±, . . . ,k n over Q, which is of degree n — 1 in every ki. For convenience we 
will occasionally write simply shorthand for the polynomial a n {k\ . . . , k n ). 

The j4 n) jj 's can be expressed in terms of a n as 



^,1,3 



a n _ 2 (l,2, l,i + 2...,j - + 1, j + 2, ...,n) 



for 1 < i < j < n. By the above, the polynomial G n (x,y) defined in ( |14[ ) can be 
expressed as a polynomial in x and y of degree no greater than n — 1 in each of x 
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and y. Following the notation of Conjecture [7J let {F rh ij)fj =1 be the coefficients of 
G n (x,y) in the expansion 

= EL t-iOC-O' <16) 

To reformulate Theorem [6j we need to prove that i*n,i,j = ^-n,i,j f° r all n > 3 and 

2.2 Two lemmas 

If x is a variable, let £7 X denote the right-shift operator in the variable x, acting on 
polynomials in x by 

(E x h){x) = h(x + l), 
and let A x denote the (right-) differencing operator in x, defined by 

(A x h)(x) = h(x + 1) - h(x) = {{E x - ld)h)(x). 

We need the following lemma, which appeared in equivalent form in [6l Lemma 1]. 

Lemma 9. Let P{X\, . . . , X n ) be a symmetric polynomial in X%, . . . , X n . Then 

P(A kl ,. . .,A kn )a n {ki, ...,k n ) = P(0, . . . ,0)a n (fci, . . . ,k n ). 

Lemma [9] is used to show the next lemma, which will be applied twice in the 
following. It involves the p-th elementary symmetric function, denoted by 

£p(Xi, . . . , X n ) := Xi L Xi 2 . . . Xi p 

l<ii<i2-..<i p <n 

(for p = 0, we take eo(Xi, . . . , X n ) = 1). As before, the notation a±, . . . , Si, . . . , a m 
for a list of objects is used to denote the list with the element aj omitted from it. 

Lemma 10. Let z be a non-negative integer, m > 1 and 1 < r < m. Then 

E^otm^!,...,^) = (-l) 2 ^ I _ )e p (E kl , . . . ,E kr , . . . ,E km )a m {ki, . . . ,k m ). 

P =o ^ z PJ 

Proof. For any q > we have e g (0, . . . , 0) =0 and 

e ? (A fcl ,. . . , A kr , . . .,A km ) = e q {A kl ,.. .,A km ) - A kr e q -x(A kl , . . .,A kr ,.. . , A km ). 
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It follows by induction, using Lemma [9j that 

^l r a m(h, ...,k m ) = (-l)%(A fcl , . . . , A kr , . . .,A km )a m (ki, . . .,k m ). 
Therefore 

El r a m (ki,...,k m ) = (A kr + ld) z a m (k 1 ,...,k m ) 



E {^jK r a rn{k 1 ,...,k m ) 

-l)%(A fcl , . . .,A kr , . . . , A km )a m (kx, ■ ■■,k ri 



q=0 

z 

E 

g=0 



(17) 



Since 



e q (A kl ,...,A kr ,..., A km ) = e q (E kl - Id, . . . , E kr - Id, . . . , - Id) 

= E ^ " 1 " P ) (-l) Q - p e P (E kl ,...,E^,...,E k J, 



the right-hand side of (17) is equal to 



£(;)(-D<£ 

q=0 w p=0 

t(-D p E(:) 



m — 1 — p 



q-p 

z\ ( m — 1 — p 



(-l) q+p e p (E kl , . ..,E kr ,..., E km )a m (ki, ...,k m ) 
£p{E kl , . . . , E kr , . . . , E krn )a m (ki, . . . , k m ). 



P 



p=0 q=p 

Using the Chu-Vandermonde summation formula 



a + b 



E 



k) (c- k 



we now get 



m>*e(;) 

q=p w 



z\ fm — 1 — p 

q-p 



(-i) p E 

q=p 

z-p 

(-i) p 



z \ fm — 1 — p 
q-p 



,z — v — r 

z + m — 1 — p 
z — p 



m — 1 — p 



■iy 



—m 
z — p 



and the assertion follows. 



□ 
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3 A first representation for F n ij 

For p > and 1 < i < n we set 

Z(n,p,i) := (e p (E kl ,E k2 ,. . . ,E kn _ 2 )a n -\j (1, 2, . . . , i - 1, i + 1, % + 2, . . . , n), 

and also define Z(n, p, 0) = 0. The proof of Theorem [6] will proceed in several stages. 
The first of these will be to deduce a formula for the coefficients F n ^j in terms of 
the numbers {Z(n,p,i)} p . 

In the following, we assume n > 3. We apply Lemma 10 with the parameters 
m = n — 1, r = n — 1, z = y and (fci, . . . , /c n -i) = (1,2, ... ,i — + l,i + 2, ... ,n), 
to get that 

C(n,i,y) := a n _i(l, 2, . . . , i - 1, i + 1, i + 2, . . . , n - 1, n + y) 

= (-l)^Z(n,p,i)(" n + 1 ) (18) 

for all non-negative integers y. 

We now consider (e q (E kl , E k% , . . ., E kn _ 2 )a n ^j (1,2, . . . ,n- l,n + y). If 1 < h < 
%2 < • ■ ■ < iq < n — 2 then 

( E kil E ki2 ...E ktq a n ^j (l,2,...,n-l,n + y) 
= ^E kii a n ^j (l,2,...,n-l,n + y) 

= a n (l,2, . . . ,i\ — l,h + l,i\ + 1, ii + 2, . . . ,n - l,n + y). (19) 
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This follows from the recurrence equation (15), which implies that the quantity on 
the right-hand side does not change if some of the numbers in position i\ + 1, i\ + 
2, ... ,n — 2 in the argument of a n are increased by one. Moreover, again by the 
recurrence (15), and using the identity (^) = (— l) fc ( fc ~^ +1 ), we get 

a n (l,2, . . . ,ii - l,h + + + 2, . . . ,n- l,n + y) 

h y 

i=l j/i=0 

h y yi 



i=l yi=0 p=0 
i=l p =o yi=p 

i=i p=o yi=p 

f^-i^rw) 

i=l p=0 



Hi — p + n — 2 
n-2 



y% — p + n — l\ (y\ — p + n — 2 



n — 1 



n — 1 



y — p + n — 1 
n — 1 



(20) 



Now divide into two cases, g = and q ^ 0. If g 7^ 0, then, since there are ( n g 2 1 n ) 
subsets of {1, 2, ... ,n — 2} with q elements and minimal element i±, it follows from 
(pi) and dlol that 



e q {E kl ,E k2 ,..., E kn _ 2 )a n ) (1, 2, . . . , n - 1, n + y) 



n-2 , ■ \ ii y 

ii=l V y 7 i=l p=0 

n-2 n-2 / . x y 

i=l j 1= i v y 7 p =o 

n-2 n-2 



n — 1 — i\ 

q 



EE 

i=l i\=i 
n-1 J/ 

^£(-lfZ(n,p,i) 
i=i p =o 



n — 2 — i\ 



y—p+n—l 
n — 1 

y—p+n—l 
n — 1 



£(-l)*Z(n,p,<. 

p=0 



y—p+n—l 
n — 1 



y—p + n—l^ [n — 1 — i 
n — 1 



(21) 



If <7 = 0, then using ( 15 ) and using the equality between the second expression and 
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the last expression in ( 20 ) , we get 
«n(l,2, 



, n 



n—l y 

l,n + y) = ^2^2C(n,i,p) + a n _i(l,2,. . . ,n - 1) 
i=l p =o 
n-1 y 



i=l p=0 



]TJ>l)^( W )( y * + ? 1 )+A n _ 1 . (22) 



n — l 



So, unifying (21) and (22) we can write 



e q (E kl ,E k2 ,..., E kn _ 2 )a n ) (1, 2, . . . , n - l,n + y) 



n-1 y 



= E E(~ i rZ(n,P, *)( y ~ P n + _ n i ~ 1 )[~ 1 a~ l ) +[q = (23) 
i=l p=0 ^ / \ 1 / 

where [statement] = 1 if statement is true and [statement] = otherwise. As a 



consequence of (23) we get that 



e q (E kl ,E k2 ,..., E kn _ 2 ,E kn )a n j (1, 2, . . . , n - l,n + y) 

e q (E kl ,. . . , E kn _ 2 ) + e q -x(E kl , . . . , E kn ^ 2 )E kn ^j a n ) (1, 2, . . . , n - 1, n + y) 
y — p + n — l\ / n — 1— i N 



n—l y 

i=l p=0 
ra-1 y+1 



n — l 



y — p + n\ / n — 1 — i 
n — l J \ q — 1 



^^(-l)^(n,M( y ;■•)(" ^ ")+[ g G{0,l}]A^i. (24) 



Now use Lemma 10 again, with m = n, r = n — 1, z = x and (fci, . . . , k n ) = 
(1,2, . . . ,n — l,n + y). This gives the following representation for the polynomial 



G n (x,y) defined in (14): 



G n (x,y) = a n (l,2, . . . , n - 2, n - 1 + x, n + y) 

= (-*)* it ( ) ( e *( E *i , E k 2 ,---, E kn _ 2 ,E kn )a n ) (1, 2, . . . ,n - 1, n + y). 
q=0 \ x q S 



16 



Combining this with (24), and using Chu-Vandermonde summation again, we get 
that 

G n (x,y) 

x , >. x n— 1 / \ 

= (-d* j> G {o. !>] " n J ^-i + c-ir E E £(-i)^(»,p, o ~j 

g=0 V y/ g=0 i=l p=0 V y/ 

( (y ~ P + n — 1\ fn — 1 — A fy — p + n\ fn — 1 — i 
X VV n-l A 9 J + V n-l A 9-1 
x + n — 2 



n-2 



Wx + EEt- 1 )"^'^) 

/ i" — 1 n— n 



j=l p=0 

y — p + n — lN/x + A fy — p + n\(x + i — l 
n— 1 J \ i J \ n — 1 

This identity is valid for all integer x, y > 0. Therefore the two polynomials in x 
and y are in fact identical. 

We want to expand this polynomial in terms of (^^Y 1 ) l) • Observe that 

y — p + n— l\fx + i\ fy — p + n\ fx + i — 1 
n — 1 J \ i J \ n — 1 J \ i 

y — p + n\ f y — p + n — 1\ \ / x + A fy — p + n\ fx + i — 1 
n-l )~ V n-2 /K » / V n -i A * 

y — p + n\ I fx + i\ f x + i — 1\\ fy— p + n — l\fx + i 
n-l )[{ i )~\ i ))~{ n-2 A i 

y — p + n\ fx + i — l\ fy — p + n — l\fx + i 
n-l )[ i-1 ) ~ [ n-2 



and therefore 



Gn(x,y) = n U _ 2 Jyln-l + EE(- 1 ) PZ ( n '^ 



1=1 p=0 

y — p + n\ fx + i — 1\ fy — p + n — l\fx + i 
n-l )\ i-1 ) ~ { n-2 )[ i 



By Chu-Vandermonde summation we have 

(y-p + m\ = ^ J+m f p \(y + j\ 

\ m-l J ' \m-jj\j-lj 
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and therefore 



Gn{X,y) = I n _ 2 J^n-l 
n— 1 n— 2 



i=l p=0 v 7 j=l v J/ v 7 

+ ED-w-.^-i)( i r-r 1 )»-^(„-!- j )G , -0- 

i=l p=0 v 7 j=l v 7 

(recall that Z(n,p,0) = 0). The coefficient of (^^l^ ) m this expression is 

+ [i = n - = l]A n ^. (25) 

4 A second representation for F n ^j 

Now define 

n-2 , 



7t — £ / 

W(n,i > j):=X;(-l)^ i+n ^(™.P ) i)( ^ ■ 



By (25), can be expressed in terms of the W(n, s,i)'s as 

F n ,i,j = [i + n]W(n,i,j) - W(n,i- l,j + 1) + [i = n - = l}A n ^. (26) 
We derive a formula for W(n, For l<i'<i<n — 1, set 

Q(n,p,i',i) = 

(e p (E kl ,. . .,E k 2 ,E ki ,. . .,E kn _ 2 )a n -i)(l,2. . . , i' - 1, i' + 1, i' + 2, . . . , n), 
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and observe that 

Z(n,p,i) = (e p (E kl ,E k2 ,. . . , E kn _ 2 )a n -A(l, 2, ...,i,...,n) 

= (e p (E kl , . . . , E^ E kn _ 2 )a n -i^j (1,2, ... ,i, ... ,ri) 

+ {e p - l (E kl ,. . .,E ki _ x ,. . .,E kn _ 2 )a n -ij(l,2, . . . , i - 1, . . . , n) 
= Q(n,p,i,i) 

+ (e p -i(E kl , . . . , E ki _ 2 , E ki _ x , . . . , E kn _ 2 )a n -^j (1, 2, . . . , i — 1 . . . , n) 
+ (e p -2(E kl , . . . , E ki _ 2 , E ki _ x , . . . ,E kn _ 2 )a n -i J(l, 2, . . . , i — 2 . . . , n) 



... = ^2Q(n,p-i + i',i',i) 



i'=i 



(for i = 0, Z(n,p,i) is and therefore also trivially equal to the expression on the 
right-hand side). Therefore, 

n—2 i / \ 

W(n, i, j) = E(-!) P+J+n ( P _ ■ ) Qi^P ~i + i'> i'> 0- (27) 
p=ch'=i ^ n 3/ 

Next we will see how Q(n,p,i' ,i) can be expressed in terms of the A nA ^s. For 
each P C {1, 2, . . . ,i! - 2} U {%, i + 1, . . . , n - 2}, set 

Q(n,P,i') = (( J] J E fcr )a n _ 1 )(l,2,...,i / -l,i , + l,i , + 2,...,n). 

Then Q(n,p, i' , i) is the sum of Q(n, P, i') over all such sets P of size p. We evaluate 
Q(n, P, i'), separating into 4 cases according as whether Pi := P f] {1, . . . ,%' — 2} is 
nonempty and whether P2 := P Pi {i, i + 1, . . . , n — 2} is nonempty. In each of these 
cases, we let Sj denote the minimal element of Pj (j = 1, 2) if Pj is nonempty. 

Case 1: Pi and P 2 are both nonempty. In this case, from the recurrence 
( |15[ ) it follows using an argument similar to the one used previously that 

Q(n,P,i') = a n _i(l,2, . . . ,si - 1, si + + 1, si + 2, . . . , 

i' — l,i' + l,i' + 2, . . . , s 2 ,S2 + 2, s 2 + 2, s 2 + 3 . . . ,n). 

= ^ ] ^n,a,b- 

l<a<si, i'<b<s 2 +l 
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Case 2: P 1 is nonempty, P 2 is empty. In this case, by a similar argument 
we have that 

Q(n,P,i') = a n _i(l,2, . . . ,s 1 - 1, s 1 + l,s 1 + 1, s 1 + 2, . . . , 

i'-l,t' + l,i' + 2,...,n) 

l<a<si , i'<b<n 

Case 3: Pi is empty, P 2 is nonempty. We have 

Q(n,P,i') = a n _i(l,2,...,i'-l,i / + l,i / + 2,..., 

s 2 , s 2 + 2, s 2 + 2, s 2 + 3, . . . , n) 

l<a<i'<b<s 2 +l, a<b 

Case 4: P = Pi = P 2 = 0. In this case, p = \P\ = and 

Q(n,P,i') = a n _i(l,2,...,i',...,n) = Am' 

l<a<i'<6<n, a<6 

Note that the number of sets P of size p with given values of si, s 2 for which 
Case 1 holds is ( l +n ^, 4 7 2 Sl ~ S2 ); the number of sets of size p with given si for which 

Case 2 holds is { i '~ 2 T 1 S1 ); Case 3 holds for ("J 82 ) sets of size p with given s 2 , and 
Case 4 holds for one set if p = 0, or for no sets otherwise. Putting all the above 
information together, we get the following formula for Q(n,p,i' 

i' — 2 n—2 f^j ^ ^ ^ ^ ^ 

Q(n,p,i',i) = n v -2 $l J E An ' a ' b 

si=ls 2 =i ^ ' l<a<si, i'<6<s 2 +l 

i'-2 / /_ 2 _ \ 

+ E V/ 1 E ^ 

si=l V F 7 l<a<si, i'<b<n 

s 2 =i V F 7 l<o<i'<6<s 2 +l, a<b 

+ [p = 0] ^ A n , a , b . 

l<a<i'<f><n, a<6 
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We change the order of summation, split up some terms into two parts, and adopt 
the convention that A n ^^ = 0, to see that 



i'-l i i'-2 n-2 



i — Z i % — z n— Z / ./ . \ 

Q(n,p,i,i) = 2^ 2^1^ E( „_ 2 M n ' a ' b 



a=l 6=i' si=a S2=i 

'-2 n-1 i'-2 n-2 



+E E E E [ ¥+n - r iT~"h 

a=l 6=i+l si=a S2=6-1 

i'-2 n i'-2 / ., \ i' i n-2 , 

i — 2 — si \ sr^ I n — 2 — S2 



+EEE „_! 1 M^+EEE(\:ri A ^ 

a=l 6=i' si=a v F 7 a=l 6=i' s 2 =« 

j' n— 1 n— 2 / o \ i' n 

+ee E r;-iT- 6+b=01 ss A ^ 

a=l 6=i+l 82=6-1 V 7 o=16=i' 



zE ( m ) ^E ( ( m -1-1 ^) ^ m 4- 1 ^ ^ ^ rn -1-1 ^ ^ m -I- 1 ) ^ ^ 



- «2 

Applying the telescopic summation 

y 

"i ( , , , , . . , 

m / ^— ' V V m + 1 / VrjT, + 1 / / V m+1 7 Vm + 1 

eliminates one summation operator from each term, and after some minor rear- 
rangement (using the fact that (°) = [p = 0] ) brings this to the form 

qw.o = EEE(C' +n ; 3 _r" S2 ) - ("; 2 -i S2 ))^ 

a=l 6=i' s 2 =i VV F / \ F // 

i'-2 n-1 n-2 



+E E E (( i+ \t7~l-C P -T)) A 



o=l 6=i+l s 2 =6— 1 
i'-2 n 

^ f ( r — l — a\ /u\ \ 4 

6 



n.a,( 



+EE(f-;-°)-c.))^- 



a=l 6=?' 



+ E E ( n * ') +EE(V) A -' a ' fe 

a=16=i' V F ' a=16=j+l V F 7 



a=l 
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Applying ( 28 ) once again to the first two terms then gives 



Q(n,p, 



ffi' + n — 2 — a — i\ (i! — a — 1 \ \ , 

EE(( P )-( p )) A 



a=l ft=i' 
i'-2 i 



n,a,ft 



a=l b— 
i'-2 n-1 



+££(-rr)+(>- 



v- - \ — / ( i' + n — 1 — a — b\ fi' — a — 1 \ \ , 

+ EE „ - „ ) ) 



o=l ft=i+l 
i'-2 n-1 



P /VP 



n,a,f 



a=l ft=i+l 
i'-2 n 



+S g(C-n-(:))- 

* (n - 1 - A n_1 /n - ft\ *' 

+ EE D V^ + EE D ) A n,a,b + \p = 0}J2An,a,n, 

a=l 6=i' \ V / a=l b=i+ i \ v / a=1 

which furthermore simplifies to 
Q(n,p, 



EE( „ K,a,*+EE( p ) A 

a=l b=i' \ r / a=1 6=i+1 V ^ 



in, a, ft 



+ E ( n ! *Wi',6+ £ ( n b )A 



v J — \ P 

ft=i'+l s ^ 7 6=i+l v ^ 



n,i'b- 



We now substitute this formula for Q(n,p,i' ,i) in (27) and interchange summation 
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operators to get 

n— 2 i—1 i b 



p=Oa=U=a+l!'=«+l J / \ r 



p+j+n ( P \fi' + n-2-a-i 
\n — j J \ n — a — p — 2 

Uh&iviUx \n-j)\n-a-b-p + i-l) 

+ EEE(-i)--f n !,)(;:;;;V^ 



p=0 6=2 i'=l 
ra—2 n i 



p=0 6=i+l i'=l 



Then, applying (28) again to get rid of the summation over i! , we get 



n— 2 i—1 i / \ 



n—2 i—1 i 

- (_l)P+i+n( P U n , a , 6 
\n — 1 1 

p=0a=lb=a+l v J/ 

f/b + n — 1 — a — A / n—l — i 
\\ n — a — p — 1 / \n — a — p — 1 

n—2 i—1 n / 

!>=0 o=l 6=i+l V J/ 

( ( i + n — a — b\ ( n — b 
\\n — a — b — p + i J \n — a — b — p + i 

+EE£(- 1 ) P+ K p )( n ~ 1 ~ l ) A ^ b 

p=0 b=2 a=l v 7 

n—2 n i / 

p=0 6=!+la=l V J/ 



which simplifies to 

n—2 i—1 i 



- EEEH^CJCt-, 1 ;;-). 



in,a,t> 

\ /; — ! / \ It — I H- /) / 

p=0 a=l fe=a+l 

+EEE(-W/J( !+ T~V> 

p=0a=16=i+l v J/ K 1 
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Now use the summation formula 

E {,n + t) (' D <" l >* = (- 1 » r+ - ('„"-?) " ^ ^ S °> 

(which follows from the Chu-Vandermonde summation together with the basic trans- 
formation formulas (f) = ( tt * 6 ) = (— ^° eliminate the summation over p 
and get that W(n,i,j) is equal to 

E E (-^'^M^E E(-« ,+i+ " +s ( 0+6 ° 

a=lfe=a+l VJ 7 o=l 6=i+l V J/ 

i— 1 * / . _ , n min(ij-l) 

= EE (" 1 ) a+J+1 L ! ! _ J A n,«,» + E ^.a^-a. 

o=l b=a+l a=max(l,i+j—n) 

Finally, plugging this into (26) we obtain a formula for the coefficients Fn,i,j- 

(i-l i /••_/, \ min(ij-l) ' 

£ J] (-1)^+1 f . ^ j _ J 4»,«,6 + E 
a=l 6=d+l ^ a=max(l,t+j-r^ 

-eeVW'-^V., 

a=16=a+l V 3 a J 

min(i— X,j) 

E Aw+j-a + [« = n - = l]A n -i, 

a=max(l,i+j— n) 

which we rewrite in the slightly more convenient form 

F n ,i,j = [i < j}A n ,i,j - [j < i}A n>jti + [i = n - = 

' i— 1 i 



\a=U=a+l V 7 / 

+E E(-ir +i+i C7_; 6 )^ 6 - (29) 

a=16=a+l V J " 7 

We have attained our first important goal, which was to derive a formula that 
expresses F n> ij in terms of the doubly-refined enumeration numbers {A ntPtg } Ptq . 
This formula immediately implies "half" of Theorem [6j namely that F n ^j = A n ^j 
for 1 < i < j < n: Iia<b<i<j then i — b < j — 1 — a and i — 1 — b < j — a and, 



n 



consequently, (j^~ L _ a ) = and ( l ~_~ ) = in this case. Moreover, 1 < i < j < 
implies j > 2 and thus [7 = 1] = 0. 

We will later use (29) again to prove the near-symmetry property of the A n) jj's 
(Theorem pi). 
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5 Finishing the proof of Theorem [6] 

We turn now to proving that F n ^j = A n ^j for the other case when 1 < j < i < n. 
Because of the way the extended doubly-refined enumeration numbers were defined 
in ([7]) , the proof of Theorem [6] will be complete once we prove the following lemma. 

Lemma 11. For each 1 < j < i < n we have 

Fn,i,j — ^ Ci,j,p,qFn,p,qi ( 3 ^) 

0<p<q<n-l 

where Cij :Ptq are defined in Q. 

For this, we appeal to another identity satisfied by a n . The following lemma is 
proved in [5] (see Corollary 1 in that paper and the paragraph below it). 

Lemma 12. For each 1 < i ^ j < n let Sij be the operator that swaps the variables 

(Sijf)(h, ...,k n ) = f(ki, ki-t, kj, k i+1 , kj-i, k i} k j+ i, ...,k n ) (when i < j). 

Then for each 1 < i < n — 1, a n satisfies the identity 

(Id + 5 M+ i)(/d+ E k .E ki+1 - E ki+1 )a n = 

(where Id is the identity operator). More explicitly this can be written as the 6-term 
identity 

a n (. . . h, k i+1 ...) + a n (. ..ki + 1, k i+1 + 1 . . .) - a n (. . . h, k i+i + 1 . . .) 

= -a n (. . . k i+1 , hi...)- a n (. . . k i+1 + 1,^ + 1...)+ a n (, . . k i+ i,ki + 1 . . .). (31) 



Applying (31 ) with i = n — 1 gives the following lemma. 



Lemma 13. The function G n (x,y) defined in (14) satisfies 



G n (x, y) + G n (x + 1, y + 1) - G n (x, y + 1) 

= -G n {y + 1, x - 1) - G n {y + 2,x) + G n {y + l,x). (32) 

Lemma 14. For each n > 1, the coefficients F n ^j satisfy the following system of 
linear equations. 

n n n n 

F n ,i,j + ^2 ^2 F n,p,q = -Fn,j,i~^2 Fn '1'P (1<*>J<«)- ( 33 ) 

p=i+l q=j p=i q=j+l 
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Proof. The claim will follow by expanding all 6 terms of eq. ( 32 ) in the linear basis 
| { xJ [l~i 1 ) (j-0 }. .1 using (28). For the terms on the left-hand side, we have that 



G n {x,y) = 5Z-P n ,tj 



x + i — l\fy + j 



G n (x,y + 1) = J2 Fn ^ 



uq 



»-i Ai- 1 



x + i-l\(y + q+l 



i — 1 J \ q — 1 



8,9 



J =1 



EE'-. 

hi \ i=j 



x + % - 1\ fy + j\ 
1 1 i-1 Jli-lJ' 



g-1 



G„(x + l,y+l) = ^^n, M r^j 

p,q ' 



P,9 \i=l 
/ n n 

E EE F » 



P,9 



X + z — 1 



hi \P= l 1=3 

and similarly for the terms on the right-hand side we have 

/ x + i-l\/y + j 



(y + j\ 



G n (y + 1,3-1) = ^F n 



j' 1 



hj 



i - 1 /V i 



G n (y + l,x) = ^ 



h3 \P=i 

n n 



x + i — l\(y + j 



G n (y + 2,x) = EEV 



* - 1 /V J 
x + i — 1\ (y + j 



hi \P=i 1=3 



By combining these expansions with ( 32 ) and comparing coefficients on both sides 
we get (1331). □ 
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Proof of Lemma 11 . Consider the system ( 33 ) as an inhomogeneous system of equa- 
tions in indeterminate variables (Fn,i,j)i<j<i<n, where (-Fn,jj)i<?.<j<n are given and 
considered as constants. We want to show that this system has a unique solution 
that is given by (30). Note that the equations (33) are symmetric in i and j, so 
one may consider only the equations indexed by pairs with j < i. First, we 
transform the system of equations into an equivalent one that is more convenient to 
handle: For each 1 < i < n — 1, subtract the equation with index (i + 1, i + 1) from 
the equation with index and for each 1 < j < i < n, subtract the equation 



with index (i, j + 1) from the equation with index (i, 
equivalent system: 



We obtain the following 



X>».m+ E 



+ > Fn,i+l,k 
k=i+2 



(1 <i < n-1) 



(34) 
(35) 



^ 1 Fn,k,j Fn,i,j+1 + Fn,j,i + ^ ~] -Fj 

k=i+l 



n,j+l,k 







(1 < j < i < n). (36) 



It is now easy to see that this system of equations is triangular (with all coefficients 
equal to 1 on the diagonal) when the variables are ordered in a reverse lexicographi- 
cal order, scanning the rows from bottom to top (i = n to i = 1) and each row from 
right to left (j = i to j = 1). This implies that the system has a unique solution. 
It remains to verify that (30) is in fact a solution. Eq. (34) is trivial (and actually 



can be thought of as the case i = n of ( 35 ) ) , so we verify ( 35 ) and (|36j) . 

For ( 35 ) , substitute ( 30 ) into the equation and equate the coefficients of F n 
to for each p < q, to see that it is necessary to check that 



E 



Ck 



-[p = i + l] 



(1 < i < n — 1, 1 < p < q < n) 



(37) 



Note that Cij^ Pi q can be written as 



c 



p 



3 + 1 

— i 



[P > j] 



so to check (37), we divide into 4 cases: 



1. p < i: In this case we get immediately that 

2. p = i: 



3 

- i - 

Ck 



[P>3 + 1} 



EL, o = o. 



E 

k=i 



Ck 



■>:P,<1 



E(-d 

k=i 

(_!)*+! 



k+q+1 



1 

q — k 



.1)9-1 



+ (-D q 
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3. p = i + 1: 

n 



k=i 





fc- 1 



+ 



■1 = _[p = i + 



4. p > i + 2: 

n 



£(-i) 9+fe+1 



k=i 



k=i 
p—i+l 



m=0 



P — Z + 1 

q — k 

p — i + l 
m 



' p — i — 1 
^ - fc - 1 

p— i— 1 

+ E (-!)' 

m=0 



p — i — 1 
m 



0. 



This confirms (35). The verification of (36) is based on a similar case analysis, 
where after substituting (30) into (36) one has to verify the identity 

n 

-ci,j+i, P ,q + E Ck ^i = ~[p = fib = i\-[p = j + M[q>i + M 

k=i 

for 1 < j < i < n and 1 < p < q < n. Here are the different cases that require 
checking. 

1- (p,q) = 

2- (p,q) = {j + l,i + l) 

3. p = j + l,q>i + 2 

4. p = j,q <i 

5. p = j,q > i 

6. p = j' + l,g<i 

7. p < j 

8. p > j + 2 

We omit the details of this verification, which are straightforward and easy to fill 
in. □ 



With Lemma 11 proved, the proof of Theorem [6] is also complete. 
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6 Proofs of Theorem [T] and Proposition [8 

We have identified the coefficients F n ^j for 1 < i < j < n as the extended doubly- 
refined enumeration numbers A n ^j. To prove Theorem [lj we now derive the system 
of linear equations satisfied by the F n ijs. This will follow from several of the 
symmetry properties of a n . Two of them are the combinatorially obvious identities: 

) k n ), 
h 



a n (ki +t,k 2 + t,...,k n +t) 
ac n (-k n , ... , -k 2 , -ki) 



a n {ki,k 2 , 
a n {ki,k 2 , 



In [HI Lemma 5] the following additional identity is proved. 
Lemma 15. 

a n (k2, k 3 ,..., k n , ki-n) = (-l) n ~ 1 a n (ki, k 2 , 



■ j k n ). 



As a consequence of the three identities (|38[), (39), (40), we get: 



Lemma 16. The polynomial G n (x,y) from (14) satisfies 



G n (x, y) = G n (-2n - y, -2n 



x) 



Proof. We use the identities (|38j), (|39j, and (|40j to get 

G n (x,y) = a n (l,...,n—2,n-l + x,n + y) 

= a n (—n — y, —n + 1 — x, —n + 2, — n + 3, . . . , —2, — 1) 



(-l) n - L a n (-n + l 



x, 



-n + 2,...,-l,-2n-y) 



(_ 1 )n-l ( _ l) n-l an( _ n + 2) 

a n (l,2,3,...,n-2,-n- 1 



(38) 
(39) 



(40) 



(41) 



. , -2, -1, -2n - y, -2n + 1 - x) 

y, -n - x) = G n (-2n - y, -2n - x). 

□ 



29 



Proof of Theorem^ Expand both sides of (41) using (16) and Theorem [6] and use 
the Chu-Vandermonde identity to get that 



1,3 



x + i — l\fy+j 



n.p,q 



p.q 



-2n — y + p — 1\ ( —2n — x + q 



p — 1 



1 



P,9 



2n — x + p\ f—2n — y + q — 1 



p — 1 



9-1 



j_i Aj — 2n + l\/x + i — 1 



vi=l 



p — I 



i - 1 



J =1 



J _ l (q-2n + l\ fy+j 

q-j J \j - 1 



n—l / n n 

EH) i+i EE^w 

jj'=0 \P=i <3=J 

n—l / n n 

EEE(-> 

*,i=0 \p=j <?=j 



p — 2n + 1^ — 2n + 1^ | f x + i — 1\ / y + j 



p — i 



J 



x + i-l\fy + j 



□ 



Comparing coefficients of (^/J) gives exactly the equations Q. 

Proof of Proposition^ The technique used to prove Lemma 16 generalizes easily 
to the polynomial G n (xi, . . . , x^), and gives the identity 

G n (xi, . . . , x d ) = (-l) ( "- 1)d G d (-2n - x d , . . . , -2n - x 2 , -2n - x x ). 



Assuming Conjecture [7J the linear equations (12) follow by expanding the functions 
on both sides of this equation in the basis 

f x\ + h x 2 + h\ fxd + 3d + d - 2\ 1 

ii-i y v J2 - 1 y " ' V id-i ) ! n, j2 ,..., jd >i 

and equating coefficients. The details are similar to the computation in the proof 
above and are omitted. □ 



7 Proof of Theorem [2 

First, note that Theorem [2] is equivalent to the evaulation A n ,n,2 
together with the claim that the modified numbers defined by 



A n -2 — A n _i 



A-n,i,j — A n ^j [i — n — l]yl n ,_i 
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satisfy the symmetry 

An,i,j — -<4-n,n+l— j,n+l— i (Aty 

for all 1 < i,j < n. The first claim is a special case of ^ (which was a direct 
consequence of ([7])). It remains to prove the symmetry. We already know it for 
i < j, so we show this for i > j. 

First, consider the case i ^ n and j ^ 1. In this case, by (29) we have 

An,i,j = [i < j]An,i,j ~ [j < i]-^-n,j,i 
i—1 i 



a=l b=a+l KJ 7 

a=l b=a+l • A 



Moreover, by Q and since Q£) =0 for n < /c, if i > j (including if i = n or j = 1) 
we have 



j'<a<6<min(i— jr'+l+a,n) 

n mm(i-j+l+a,rt) 



^, +1+ e e (-^(c^-t 1 - n:j)K- 

a=j b=a+l v v 7 v 

n min(i-j+l+a,n) 

1 [ (a-j- i<\ ^ ( a- j \ \ A 

n,a,i 



^, +1 +E E (-^(( a 7^7>G!7^i)) A 

a =j 6=a+l v v 7 v 

E E (-l) i+b+1 ( a K,a, b 



E E(-i) ,+m u!77>-> («) 



a=j fe=a+l 
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If we add these two representations for F n ^j we get that 

\i+b+l ( a ~ 3 - 1 



n n 



2A 



-2[i^j]A n ,j, i + E E 

a=j+l b=a+l 



b-i 



A 



n,a,b 



n n 



a=j b=a+l 

+E E (- 1 ) a+J+1 

a=l b=a+l 
i-2 i-1 

+E E c- 1 )^ 1 

a=l fe=a+l 



i+ft+1 / a ~~ J 



b-i-1 

i - b 
j-l-a 

i-l-b 

j -a 



-<4-n,a,i 



A, 



A 



n,a,b' 



(44) 



We set 



n n 



D 



E E(-D l 

a=j+l 6=a+l 
n n 

+E E 

a=j 6=a+l 
i— 1 t 



i+6+1 ( a ~j~^ 

b-i 



in, a, 6 



+6+1 / a - J 
b-i-1 



i - b 



A 



+E EH) fl+i+i ( f ;; 

a=l 6=a+l 

i-2 i-1 

+E E (-!) a+i+1 

a=l b=a+l 



i — 1 — 6 
i - a 



n,a,b 



and observe that because of (44), it is enough to show that -t>n,i,j = f n ,n+i- 3 ,n+i-r 
In this formula, we replace all occurrences of Ai,a,f> by j4 ra ,n+i-b,n+i-a- Then we 
replace b by n + 1 — a' and a by n + 1 - and obtain the following. 

n-j b'-l 



Amj = EE(- 1 ) i+a ' +n 



6'=la'=l 

n+l-j fe'-l 



A. 



'+n 



+71 



E E(- 1 )' +a ' 

fe'=l a '=l 

n 6'-l 

E E i- i ) j+b ' 

b'=n+2—i a'=n+l— i 
n b'-l 

E E (-iy +b ' +n 

b'=n+3—i a'=n+2—i 



n — b' — j 
n+\ — i — a 1 

n + 1 — j — b 



n — i — a 



A 



n.a'.b' 



-n — 1 + i + a 



-n-2+j + b 

-n-2 + i + a! 
-n-l+j + V 



A nj a' ,b' 
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If we exchange the order of the summation in the four double sums (and replace a' 
by a and b' by b) then we obtain 



D 



\i+a+n 



n — b — j 
n + 1 — i — a 

fn + l—j — b 



n—j—l n—j 

n« = E EH") 
a=l b=a+l 

n-j n+l-j 

a=l b=a+l 
n— 1 n 

+ E £(-i) i+H " 

a=n+l— j 6=a+l 
n— 1 n 

+ E E (-i) i+6+n 

a=n+2— i b=a+l 

and this expression is obviously equal to D nn+ \-j n 



A r . 



A 



n,a,b 



\ n — i — a 

-n — 1 + i + a 
-n - 2 + j + b 

-n — 2 + % + a 
-n — 1 + j + 6 



A n a j 



3,n+l— i • 



Finally, we prove (42) for the case that i = n or j = 1. It suffices to consider 
the case i = n, since j = 1 implies n + 1 — j = n. That is, we have to show 

A n ,n,j ~ ^-n,n+l— j,l + [j = 2]A n _i = 0. 



For A n:n j we use the formula from (43) and for A^^+i-^i we use (29). This gives 

An,n,j ^n,n+l—j,l + [j = 2] A n _i 

( a ~ j ~^ 



n n 



-[n^j]A nd>n + ]T £ (-iy 

a=j+l b=a+l 



, J Ayj Q , 

o — n ' 



n+6+1 ( a 3 

b — n — 1 



A 



n,a,b 



+E E (-D r 

a=j fe=a+l 

+[n + 1 - j ^ l]A nj i iTl+ i_j - [j = 2]A n _! + [j = 2]A n _i 

n—jn+l—j , ■ i\ n ~^~3 n ~j 

-EEH)'" +1 :;" l v-E E(-'r("; 



a=l b=a+l 



a=l fe=a+l 



n — j — b 



in,a,b- 



Since the second and the third double sums vanish and [n ^ j] A n j^ n = [n + l — j ^ 
1] A nj i >n +i_j, it remains to show that 



ra-l 



n-j 



'y ] A raia ?1 + ^ ^ A n \ — 0. 

a=j+l 



6=2 



This follows from the symmetry of the A njPi<? 's when p < q. 



□ 
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Appendix A: Numerical tables 



1 

1 1 

2 3 2 

7 14 14 7 

42 105 135 105 42 

429 1287 2002 2002 1287 429 
7436 26026 47320 56784 47320 26026 7436 

Figure 4: The numbers A n:k for 1 < n < 7 
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n = 3 




n = 4 



/ 2 3 2 \ 

-2 2 4 3 

2 12 2 

\ -7 -5 -2 / 



n = 5 



n = 6 



/ 





7 


14 14 


7 \ 










-7 


7 


23 26 


14 










-21 


-2 


16 23 


14 










7 


-7 


-2 7 


7 








\ 


-42 


-35 - 


-21 -7 


o / 








/ 





42 


105 


135 


105 


42 


\ 




-42 


42 


203 


300 


250 


105 






-147 


-56 


161 


322 


300 


135 






-282 


-179 


-8 


161 


203 


105 






42 


-177 


-179 


-56 


42 


42 




V 


-429 


-387 


-282 


-147 


-42 





/ 



n = 7 



( 





429 


1287 


2002 


2002 


1287 


429 


\ 




-429 


429 


2847 


5174 


5551 


3731 


1287 






-1716 


-1131 


2418 


6422 


7748 


5551 


2002 






-3718 


-3874 


-546 


4004 


6422 


5174 


2002 






-5720 


-5707 


-4043 


-546 


2418 


2847 


1287 






429 


-4433 


-5707 


-3874 


-1131 


429 


429 




\ 


-7436 


-7007 


-5720 


-3718 


-1716 


-429 





/ 



Figure 5: The extended doubly-refined enumeration coefficient matrices {A n ^j)™ j=l for 
3 < n < 7. 
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Appendix B: The Mathematica package Ref inedASM 

The Mathematica 6.0 package Ref inedASM can be downloaded from the authors' 
web pages. Here's a sample output to demonstrate the computation of the A n i j's 
for n = 6 (which at the same time verifies the correctness of Conjecture [3] for that 
value of n) and the verification of Conjecture [4] for 3 < n < 8: 

ln[1 1 ] := MatrixForm[DoublyRef inedEnumerationNumbers [ 6 ] ] 

Out[11]//MatrixForm= 






42 


105 


135 


105 


42 


-42 


42 


203 


300 


250 


105 


-147 


-56 


161 


322 


300 


135 


-282 


-179 


-8 


161 


203 


105 


42 


-177 


-179 


-56 


42 


42 


-429 


-387 


-282 


-147 


-42 






ln[12]:= MatrixForm[ExplicitDoublyRef inedEnumerationNumbers [6 ] ] 

Out[12]//MatrixForm= 






42 


105 


135 


105 


42 


-42 


42 


203 


300 


250 


105 


-147 


-56 


161 


322 


300 


135 


-282 


-179 


-8 


161 


203 


105 


42 


-177 


-179 


-56 


42 


42 


, -429 


-387 


-282 


-147 


-42 






ln[13]:= Verif yExplicitFormula [ 6 ] 

Out[i3]= True 

ln[14]:= Verif yExplicitFormulaForRange[3 , 8] 

n=3 True 
n=4 True 
n=5 True 
n=6 True 
n=7 True 
n=8 True 
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